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We  present  a  normative  decision  model  for  hierarchical  organiza¬ 
tions  whose  levels  operate  at  different  tempos.  We  describe  the 
mathematical  methodology  whereby  each  level  forms  internal  models 
of  the  detailed  state  process#  corresponding  to  its  tempo  of 
operation.  Based  on  these  models,  we  describe  a  rational  aggregate 
strategy  for  the  hierarchical  organization. 
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1.  Introduction 


In  many  of  the  presentations  included  in  the  proceedings  of  this 
MIT-ONR  c2  workshop,  a  distinction  has  been  made  between  the  physical 
(electronic,  human)  system  used  to  gather  and  distribute  information 
and  commands,  (the  C2l  system)  and  the  processing  of  this  information 
to  select  appropriate  courses  of  action  (the  C2  process) .  It  is  the 
contention  of  many  researchers  that  any  evaluation  of  a  C^I  system  is 
influenced  by  the  C2  process  which  it  supports.  This,  in  turn,  requires 
proper  understanding  of  how  decisions  are  made  in  the  complex  environment 
in  which  C2  systems  operate. 

2 

One  of  the  most  interesting  aspects  of  the  C  decision  processes 
in  the  C3  environment  is  that  decisions  must  take  into  account  the 
presence  of  other  decision  makes  in  the  environment.  Furthermore, 
these  decision  makes  are  often  arranged  in  a  hierarchical  fashion, 
distributed  throughout  the  environment,  as  illustrated  in  figure  1. 

Although  figure  1  represents  a  simplistic  view  of  a  organization, 
it  serves  to  highlight  several  important  points :  First,  the  presence  of 
a  hierarchical  structure  indicates  that  different  perspectives  of  the 
same  environment  are  needed  at  each  decision  level.  Second,  the  amount 
of  interaction  between  different  nodes  at  the  same  level  is  often  small, 
since  they  are  typically  interacting  with  different  parts  of  the 
environment. 

In  this  paper,  we  study  the  problem  of  developing  a  normative, 
rational  model  of  a  decision-maker  operating  as  part  of  the  C2  process 
in  the  C2  environment.  This  model  reflects  several  important  issues:  the 
presence  of  many  decision  makes  in  a  system,  the  hierarchical  nature  of 
the  decision  structure,  and  the  existence  of  different  perspectives  of 
the  environment  at  different  decision  levels.  The  model  is  developed 
as  a  precise  set  of  mathematical  axioms.  The  consequences  of  these 
axioms  are  then  explored  in  the  context  of  some  simple  dynamic  decision 
problems. 


The  paper  is  divided  into  two  main  parts.  The  first  part  discusses 
in  some  detail  the  problem  of  developing  mutually  consistent  mathematical 
models  which  represent  perceptions  of  the  environment  at  different  levels 
of  aggregation.  The  basic  concept  used  in  this  part  is  that  of  tespo, 
or  time  scale,  of  operation.  Based  on  an  underlying  accurate  global 
description,  consistent  aggregate  models  are  given,  which  represent  the 
evolution  of  the  system  at  a  specific  tempo  of  operation.  The  accuracy 
of  these  models  is  characterized,  and  conditions  are  given  which  specify 
when  such  models  can  be  obtained.  This  part  of  the  paper  is  a  brief 
summary  of  the  results  of  [11 ,  consisting  of  joint  work  with  Mr.  Marcel 
Coderch,  Prof.  A.  Willsky  and  Prof.  S.  Sastry  of  MIT/LIDS. 
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The  second  part  of  the  paper  proposes  a  normative  model  for  each 
decision  maker  in  the  environment  which  uses  the  aggregate  models 
obtained  in  the  first  part  of  the  paper.  The  concept  of  aggregate 
rationality  is  proposed  as  a  desirable  solution  to  the  overall  decision 
problem,  using  concepts  from  game  theory  and  hierarchical  structures. 

The  development  of  consistent  aggregate  models  which  are  accurate 
at  a  specific  time  scale  is  a  problem  which  has  received  considerable 
attention  in  recent  years.  The  works  of  Kokotovic  et.al.  [2], 

Korolyuk  [3] ,  Papanicolaou  [4] ,  and  other  are  typical  of  the  results 
obtained.  Most  of  these  authors  developed  approximations  which  were 
only  valid  at  one  specific  time  scale.  An  extension  of  this  work 
to  a  hierarchy  of  models  at  many  time  scales  was  developed  in  [1] . 

The  work  on  aggregation  which  we  report  here  is  a  summary  of  our 
results  in  [1] . 

Dynamical  decision  problems  with  different  cost  criteria  and  a 
hierarchical  structure  have  been  studied  extensively  in  the  literature, 
under  the  name  of  Stackelberg  games.  The  first  authors  to  study  these 
class  of  decision  problems  were  Chan  and  Cruz  15] .  Their  work  was 
extended  by  many  authors,  [6],  [7].  In  particular,  Basar  and  his  co¬ 
workers  [8]- [9]  have  studied  the  solution  of  Stackelberg  decision 
problems  using  incentive  strategies  to  achieve  goad,  coordination 
between  different  decision  levels. 

The  results  in  this  paper  combine  the  concepts  of  aggregate  modeling 
and  hierarchical  decision  theory  to  produce  a  mathematical  theory  of 
rational  behavior  which  captures  some  important  features  of  realistic 
decision  situations.  First  of  all,  decision  makers  involved  at  the  higher 
(more  "global")  levels  of  the  decision  hierarchy  will  use.  coarser, 
aggregate  models,  and  operate  at  a  slower  tempo  than  their  low-level 
counterparts.  Their  decisions  sure  interpreted  as  global  directives,  to 
be  amplified  and  interpreted  by  their  subordinates.  This  model  of 
rational  behavior  is  different  from  the  classical  game-theoretic  models 
of  hierarchical  decision  structures,  where  the  higher  levels  are 
required  to  have  more  detailed  information  about  the  system  than  their 
lower  level  counterparts. 

The  second  important  aspect  of  this  theory  is  that  it  proposes  an 
analytical  way  for  developing  internal  models  (for  each  decision  maker) 
at  a  specified  tempo  of  operations,  starting  from  a  microscopic  reality. 
This  may  not  seem  as  an  important  advantage  in  real-life,  on-line  analysis 
of  events,  because  a  microscopic  model  of  reality  is  not  readily  available. 
However,  this  result  is  useful  for  off-line,  analytical  studies  of  the 
value  of  C^I  equipment  supporting  a  set  of  decision  makers,  where  the 
scenarios  are  pre-specified  and  controlled. 


Finally,  it  should  be  stressed  that  all  of  the  results  presented 
in  this  paper  are  strictly  part  of  an  analytical  methodology,  which 
needs  to  be  tested  to  decide  its  actual  value  in  the  study  of  systems. 
The  concept  of  aggregate  rationality  is  speculative,  and  needs  to  be 
investigated  further.  In  addition,  the  methodology  has  been  developed 
to  the  level  where  simple  models  can  be  studied.  It  remain  to  be  seen 
whether  additional  extensions  will  make  it  sufficiently  general  to  have 
practical  significance. 


2.  Hierarchical  Aggregation  of  Linear  Systems 

This  section  is  a  brief  overview  of  the  results  in  II].  For  a 
complete  proof  of  the  main  theorem,  as  well  as  precise  mathematical 
statements,  the  reader  is  referred  to  [1]. 

We  begin  by  postulating  a  dynamic  model  which  describes  the 
entire  evolution  of  the  system  when  no  decisions  sure  applied.  We 
assume  that  the  system  state,  of  finite  dimension,  evolves  according 
to  a  differential  equation  of  the  form 


^-A(€)x  (2.1) 

where  x  represents  the  state  vector,  and  A(e)  is  a  matrix  which  depends 
on  a  small  parameter  €,  as 


A(e)  -  l  A  el  (2.2) 

i-0  1 

The  presence  of  the  parameter  €  is  used  to  model  the  different 
tempos  at  which  events  occur  in  the  evolution  of  the  system.  For  ins¬ 
tance,  e  reflects  the  strength  of  the  coupling  between  events  occurring 
distant  corners  of  the  environment,  or  the  ratio  between  the  average 
delay  for  decisions  at  a  high  level  in  a  hierarchy,  and  the  average 
delay  for  decisions  at  a  lower  level.  The  formulation  of  a  system 
model  with  a  properly  identified  structure  of  the  form  (2.1)  and  (2.2) 
is  a  difficult  engineering  task  which  we  do  not  address  here.  We 
assume  that  the  model  (2.1)  is  given,  and  that  €  has  been  chosen  ap¬ 
propriately  on  physical  grounds. 

Based  on  the  model  of  equation  (2.1),  there  are  two  important 
questions  to  answer:  Given  a  specified  tempo  of  operation  (time-scale) , 
does  there  exist  a  simple  aggregate  model  of  the  system  which  accurately 
reflects  the  evolution  of  the  model  in  equation  2.1?  If  so,  what  is 
that  model?  The  purpose  of  this  section  is  to  make  these  questions 
mathematically  precise,  and  to  provide  an  answer  in  some  cases. 


We  begin  with  some  mathematical  preliminaries.  The  solution  of 
equation  2.1,  considered  as  a  time  function  on  the  semi- infinite 
interval  [0,®) ,  can  be  written  as 


*€<t>  -  eA(€)t*0  *  te[0,®)  (2.3) 

for  arbitrary  initial  conditions  x^. 

An  aggregation  y(t)  of  the  trajectory  x(t)  is  a  mapping 

G:  X**Y 

where  X  is  the  state  space  of  x(t) ,  and  Y  X  is  a  proper  subspace 
of  X.  Usually,  Y  is  defined  through  an  equivalence  relationship 
which  identifies  equivalent  states  in  X. 

Our  objective  in  this  section  is  to  establish  conditions  on 
the  system  2.1  such  that,  when  the  system  is  viewed  at  a  specific  tempo 
or  time  scale  t  ■  t/f(€),  the  evolution  of  the  system  state  can  be 
approximated  by  an  aggregate  model,  operating  at  the  T  time  scale. 
Mathematically,  we  want  to  define  an  aggregate  trajectory 
£ 

y  (T) ,  with  its  own  generating  model 


£ 

§*-  (T)  -  A(1)  (€)  y€(T)  (2.4) 

such  that 

lim  sup  ||ye(T)-G(x€(t/f(€)))||-0  (2.5) 

e+0  0<T<® 

Equation  2.5  demands  that  the  aggregation  must  provide  an  accurate 
representation  of  the  time  trajectory,  depending  on  the  physical 
parameter  6. 

The  primary  result  in  [1]  can  be  stated  as  follows: 

Let  Aq (G) ,  for  e  in  10, e^] ,  be  a  matrix-valued  function,  with 
constant  rank  d  for  0<e<e^ .  Assume  furthermore  that  AQ  (e)  has  semi- 
single  null  structure  (a  full  complement  of  zero  eigenvector  for  all  6) . 
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Construct  the  sequence  of  matrices 


»<0>  -  ». 


P.  -  lim 
1  t*» 


A(i,t 


i-0,1 


A(1)  “ 

0  1  Q 


(21  + 

A  »  P.P- (A  -A, A.  A, )P_P, 
10  2  10  101 


where  A*  •  any  pseudo- inverse  of  AQ. 

The  exact  construction  of  the  rest  of  the  sequence  A^ ,  i>2 
is  described  in  [1]  and  [10].  For  the  purposes  of  the  theorem 
statement,  we  need  to  define  one  more  term.  A  matrix  A  is  semistable 
if  and  only  if 


sup 

t 


<  00 


Theorem  [1] :  Let  AQ  (6)  be  a  matrix  with  semisinrple  null  structure. 

If  A  ^  , . . .  ,A^  are  semistable  matrices  with 

2  (i) 

l  rank  A  »  d,  then 
i-0 

lim  sup  ||e*^*  -  ♦(«,t)||  «0 
e*0  t>0 


♦  («,t) 


n  e 

k-0 


wl lere 


Furthermore,  for  any  specific  time  scale  T ■  t/Je  .  let 
k-1 

IL  ■  II  P. .  Then, 

*  i-0  1 

e  , (k) t 

lia  sup  |  |  *  (t/_k)  -  7T  e  x  |  |-0  . 
e+0  0<t<T  u 

Also,  the  only  non-trivial  time  scales  are  integer  powers  of  € 
less  than  or  equal  to  m. 

The  last  formula  in  the  theorem  defines  our  aggregate  process. 
Define  the  equivalence  relation  x^  ~  if  and  only  if 

»  ^*2  *  I*et  t^ie  factor  space  of  equivalence  classes 

of  X  under  .  Then,  there  is  an  aggregate  model  for  the  evolution  of 
y (T) ,  given  by  the  restriction  of  the  flow 

A(k)t 

x(T)  -  ire  z  x 
k  0 

to  the  subspace  Range  The  exact  construction  of  this  aggregate 

model  is  a  question  of  simple  algebra,  described  in  [1] . 

Although  the  conditions  of  semistability  required  for  the  existence 
of  accurate  aggregate  models  at  specific  tempos  of  operation  appear 
stringent,  there  are  numerous  examples  of  systems  which  satisfy  these 
conditions.  An  important  class  of  systems  is  that  of  positive  systems, 
where  the  trajectory  of  x(t)  is  lies  in  the  positive  orthant.  An 
example  of  such  a  system  is  the  evolution  of  the  probabilities  of  a 
stochastic  finite  state  Markov  process.  Further  development  of  these 
results  will  appear  in  a  forthcoming  paper. 

There  are  many  issues  concerning  aggregate  models  which  have  not 
been  addressed  in  this  section.  We  have  analyzed  only  the  free,  un¬ 
controlled  evolution  of  the  system  2.1.  The  presence  of  control  actions 
has  not  been  modeled;  these  actions  can  change  the  time  structure  of  the 
system.  An  example  of  such  a  change  in  structure  consists  of  a  supreme 
commander  taking  direct  control  of  a  low-level  operation.  In  this  case, 
new  informational  links,  much  faster  than  the  standard  channels,  have  to 
be  set  19  in  order  to  provide  relevant  information  to  the  supreme  level, 
about  the  details  of  the  operation.  What  we  have  developed  in  this 
section  is  the  concept  that,  if  there  are  natural  tempos  of  operation 
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for  different  decision  nodes  monitoring  a  specific  environment, 
simplified  aggregate  models  can  be  obtained  which  approximate  the 
system  at  those  tempos  of  operation.  The  next  section  will  expand 
upon  these  ideas  by  studying  the  problem  of  decision  making  in 
such  an  environment. 


3.  Games  with  Uncertain  Models 


Informally,  game  theory  can  be  viewed  as  the  scientific  study  of 
decision  making  in  situations  with  possible  conflicts  of  interest. 

As  discussed  in  standard  textbooks  (e.g.  [11]),  a  game  can  be  analyzed 
in  terms  of  a  three  components  (U, J, S) ,  as  follows : 

The  set  0  is  the  set  of  all  possible  decision  strategies  which  caui  be 
used  by  all  decision-makers  (players)  in  a  game.  Typically,  U  can  be 
decomposed  in  product  form  as 


U  »  U.  x  U_  x. . .x  U 
—  —12  m 


(3.1) 


where  m  is  the  number  of  players  in  the  game,  indicating  that  the 
choice  of  strategy  is  unconstrained  by  other  player's  strategies. 

m 

The  element  J,  the  performance  function,  is  an  R  -  valued  real 
function,  which  assigns  a  set  of  utilities  to  each  player  for  each 
choice  of  admissible  strategy  u  €  U •  Mathematically, 


m 

J:  0  •+•  R 


The  third  element  S  is  the  controversial  part  of  game  theory. 
The  set  S  is  called  a  solution  concept,  or  a  selection  rule,  and  its 
purpose  is  to  identify  sets  of  strategies,  based  on  the  performance 
function,  which  can  be  accepted  as  rational  outcomes  for  the  play  of 
the  game.  Hence,  we  specify  S  as  a  subset  of  U  completely  described 
by  a  condition  in  terms  of  J.  That  is. 


S  ■  {u*  €  U5  C(J(u*))  is  satisfied}  (3.2) 

As  an  example  of  a  typical  selection  rule,  consider  the  problem 
of  minimizing  a  specific  cost  functional,  H (u) .  The  condition  becomes 


1 


H(u*)<  H(u)  for  all  u  6  0  . 


LEVEL 

nv-1 


LEVEL 

1 
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Once  the  parameters  of  the  game  are  established,  and  become  known 
to  all  players,  each  player  is  in  an  individual  position  to  compute  all 
elements  of  the  set  S.  Typically,  S  will  consist  of  a  single  element, 
thereby  defining  uniquely  the  rational  course  of  play  for  the  game. 

Each  player  is  assumed  to  follow  his  rational  course  of  action,  as 
established  by  the  selection  rule  S. 

There  sure  several  implicit  assumptions  which  need  to  be  considered 
carefully  when  one  studies  the  concept  of  rational  solutions  of  games, 
as  described  above.  First  of  all,  the  assumption  is  made  that  all 
players  have  access  to  the  complete  detailed  model  (U,  J,S_) ,  so  that  each 
player  can  individually  compute  the  rational  strategy  set  S. 

Second,  the  situations  where  S  has  many  elements  have  to  be  resolved 
by  an  additional,  unspecified  mechanism  to  identify  a  single  rational 
play  of  the  game. 

In  terms  of  the  discussion  on  aggregate  models  specified  in 
Section  2,  the  classical  game  assumptions  would  require  each  level  to 
have  a  complete  microscopic  model  of  the  situation,  in  order  to  be 
able  to  evaluate  accurately  all  of  the  possible  payoffs  corresponding 
to  individual  plays  of  the  game.  This  contradicts  the  philosophy  of 
using  simpler  models,  valid  at  specific  tempos  of  operation,  which  was 
proposed  in  section  2.  In  the  rest  of  this  section,  we  propose  a  new 
normative  model  for  determining  rational  solutions  to  game  problems, 
which  we  denote  as  L,  aggregate  rationality. 


Our  first  assumption  is  that  each  decision  maker  in  the  game  has 
an  intrinsic  tempo  of  operation,  which  cannot  be  changed  by  the 
strategies  of  other  decision  makers.  Basically,  this  implies  that  the 
aggregate,  internal  models  used  for  decision  purposes  will  not  change 
dramatically  with  the  choices  of  strategies .  We  will  make  this 
concept  mathematically  precise  in  this  section. 


For  the  present,  we  will  restrict  ourselves  to  discussing  games 
with  a  strict  hierarchical  structure.  That  is,  decision  makers  are 
arranged  in  a  structure,  as  in  Figure  2.  To  each  level  in  the  hierarchy, 
we  assign  tempo  of  operation,  together  with  an  internal  model,  which 
describes  the  evolution  of  the  system  state  at  that  tempo.  In  addition, 
we  define  a  "meta-game"  at  that  tempo  which  involves  an  aggregate  model 
of  all  other  decision  levels'  objectives  and  actions.  Based  on  this 
perceived  game,  each  level  is  able  to  compute  its  rational  aggregate 

strategy. 

Formally,  assume  that  the  state  of  the  system  evolves  according  to 
the  differential  equation 


dx 

dt 


A(e)x(t)  +  l  B.(6)u,(t) 
i*l 


(3.3) 
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where  m  is  the  number  of  levels  present  in  the  hierarchical  structure. 

We  assume  that  A(€)  can  be  factored  into  a  form  which  explicitly  displays 
a  multiple  time  scale  structure,  as 


A(€)  ■  diagjl,€I, . . . • 


Au(€)  .. 

...A,  (€) 
lffl 

A  .  (€) 

ml 

...A  (€) 

mm 

(3.4) 


where  the  block  matrices  A^(€)  are  also  analytically  dependent  on 
€.  Partition  the  state  vector  x(t)  conformally  as 


x  (t) 


f  x^  (t)  ' 


^  X  ( t )  1 
m 


(3.5) 


Notice  that  this  partition  creates  a  causal  structure  in  terms  of 
aggregate  models.  At  the  fastest  time  scale,  x^Ct)  describes  the 

evolution  of  the  relevant  variables,  influenced  by  the  levels  set  by 

the  slower  states  x. (t) , . . . . ,x  (t) .  At  the  next  time  scale,  T=€t, 

2  n 

the  fast  transients  of  x^(t)  have  died  out,  leading  to  a  reduced  model, 
whose  principal  evolution  is  described  in  terms  of  x^ (t) . 

The  control  laws  u,  (t) ,  u. (t),...,u  (t)  are  assumed  to  vary 

12m 

at  the  natural  time  scale  of  the  decision  level,  or  slower.  Hence, 


u2  (t)  =  u2(et) 

u3(t)=  u3(62t) 
uk(t)=  V^t) 


(3.6) 


The  strategies  cure  selected  in  a  hierarchical  order,  starting  from 
the  slowest,  or  most  aggregate,  level.  At  the  fastest,  most  detailed 
level,  all  of  the  higher  levels  have  announced  their  strategy,  so  that 
the  choice  of  strategy  at  this  level  is  reduced  to  solving  for  a  single 
decision  maker's  strategy.  This  strategy  is  parametrized  by  the  higher 
level's  decisions,  which  vary  in  a  slower  time  scale. 

Rational  play  in  the  game  is  determined  as  follows:  At  the  most 
detailed  level,  with  a  tempo  t  of  order  t,  the  performance  criteria  is 
given  as 
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where  the  evolution  of  the  vector  process  x  is  governed  by  equation 
(3.3).  Since  level  1  is  the  lowest  level,  we  assume  that,  from  the 
hierarchical  structure  of  the  game,  that  the  strategies  from  players 
2  through  m  are  known,  so  that  player  1  can  determine  his  optimal 
strategy  in  a  straightforward  optimal  control  problem. 

For  level  2,  the  natural  time  scale  is  T  *  t/€.  At  this  time 
scale,  the  evolutions  at  the  tempo  T*t  have  achieved  their  steady 
state.  That  is. 
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where  we  have  assumed  that 


u^t)  -  u*(t)  +  u®S(€t) 
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so  that  the  local  decisions  of  level  1  cam  be  divided  into  short  term 
and  long  term  strategies. 

Hence,  the  decision  problem  at  level  2  can  be  described  in  terms 
of  an  aggregate  game.  The  cost  function,  in  the  T  *t/€  scale,  is 
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where  the  evolution  of  is  assumed  to  have  reached  steady  state,  so 

that  x^  is  no  longer  a  dynamic  variable.  In  addition,  in  order  to 

completely  define  a  well-posed  decision  problem  for  player  2,  we  must 
specify  an  internal  model  of  player  l's  long-term  strategy  to  be  used 
by  player  2.  We  use  our  aggregation  philosophy,  to  specify  a  perceived 
decision  model  for  level  1. 

In  level  2's  tempo,  level  l's  decision  problem  becomes 
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subject  to  the  same  dynamic  model  used  at  level  2.  Note  that  this 
perceived  problem  neglects  the  faster  evolution  teems  present  in 
level  l's  original  cost.  Hence,  it  is  only  the  perceived  decision 
problem,  at  level  2's  tempo,  rather  than  the  actual  decision  problem. 
This  perception  is  obtained  by  using  our  philosophy  of  defining 
aggregate  models  based  on  tempo. 

Following  this  structure,  we  endow  level  i  with  its  own  cost 
function,  of  the  form 


(3.12) 


subject  to 

*. . . j-0  ,  (3.13) 

and  define  perceived  decision  problems  at  this  tempo,  consistent 
with  the  original  decision  problem  specified  at  faster  tempos. 

We  call  the  set  of  strategies  which  are  optimal  under  this  decision 
structures  the  aggregate  rational  strategies.  In  the  next  section,  we 
illustrate  the  implications  of  this  concept  in  the  context  of  a  simple 
example. 


4.  Example 


For  the  sake  of  simplicity,  we  consider  an  example  with  two  levels 
of  decision  making.  Furthermore,  to  illustrate  the  different  time 
scales  of  the  system,  we  assume  that  one  component  of  the  state  vector 
operates  in  discrete  time,  while  the  other  evolves  continuously. 


Assume  that  the  system  state  is  described  by  the  evolution  equation 
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The  system  has  two  natural  time  scales  of  evolution:  T -  €t, 
corresponding  to  the  evolution  of  the  y  process,  and  t,  for  the  discrete 
part.  We  assume  that  there  are  two  decision  levels,  with 

corresponding  to  the  fast  level,  and  ufc  to  the  slower  level.  The 

performance  measure  associated  with  v  is 
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while  the  performance  measure  associated  with  ufc  is 
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It  is  assumed  that  x ,  u  are  constant  on  [t,  t+1) 
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We  begin  with  the  problem  seen  by  u  .  At  the  t  time  scale , 
y*0.  Hence 
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Hence,  the  dynamical  system  seen  by  u  is 
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Furthermore,  his  perception  of  is 


(4.5) 


(4.6) 


*5 


00 

l 

t-0 


♦  (*t-v 


(4.7) 


In  this  dynamical  problem,  player  0  is  seen  as  a  leader  in  a  hierarchical 
problem.  In  most  cases,  he  can  use  a  memory-dependent  strategy  which 
achieves  the  team-optimal  performance,  by  using  goal  coordination.  We 
compute  such  a  strategy  in  the  following  discussion. 


Assume  that  u  and  v  were  a  team, 
the  optimal  strategies  would  be 


with  common  goal  (4.4).  Then, 
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In  order  to  achieve  this  optimal  trajectory,  level  2  can  use 
a  goal-coordination  memory  strategy,  of  the  form 


u*  -  a*xfc  +  g(xt-(3-a*-3b*)xt_1) 


(4.11) 


The  exact  value  of  g  depends  on  the  cost  criterion  used  at  level  1. 
According  to  (4.7),  when  (4.11)  is  used  as  a  strategy,  the  resulting 
optimization  problem  for  v  is 


min  »  l  *1  +  (x  -u*-v®)  +  v* 

*  t»0  u  t  t  t  t 


(4.12) 


The  exact  value  of  g  can  thus  be  calculated  as  the  value  for  which 

b*x^  is  the  optimal  strategy  which  minimizes  (4. 12) .  We  have  not 

taken  the  time  to  compute  this  value,  because  it  involves  tedious 
algebraic  manipulations  better  left  to  machines. 

Once  level  2's  rational  strategy  (4.11)  is  decided,  the  next 
step  is  to  solve  for  the  rational  strategy  of  level  1.  This  involves 
looking  at  the  detailed  performance  index  (4.3).  Due  to  the  consistency 
between  (4.3)  and  (4.7),  the  effect  of  u*  is  to  force  the  slow  part 
of  v  to  match  the  optimal  slow  strategy  (4.9).  However, 


where 


vfe  ■  vfc  +  v(T) 
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Note  that  the  choice  of  v(T)  is  not  constrained  by  the  strategy 
u*,  because  it  is  varying  much  faster  than  the  ten^o  used  for  decisions 

at  the  discrete  time  scale.  The  strategy  v(T)  can  be  determined  from 
the  reduced  problem  on  the  T  time  scale. 


5.  Conclusion 


The  concept  of  aggregate  rationality  introduced  in  section  3  and 
illustrated  in  section  4  provides  an  interesting  decision  model  for 
hierarchical  organizations.  By  prescribing  a  sequence  of  perceived 
games,  rational  strategies  can  be  defined  at  each  level  of  aggregation. 
Sene  of  our  preliminary  investigations  hint  that  the  concept  of  ag¬ 
gregate  rationality  is  very  robust)  that  is,  there  is  little  benefit 
to  be  gained  from  using  more  detailed  models  for  decision  making. 

We  are  in  the  process  of  developing  a  rigorous  mathematical  theory 
which  will  expand  on  the  concepts  presented  here.  In  particular, 
there  are  several  key  questions  which  must  be  addressed,  concerning 
well-posedness  of  the  solution  problem,  and  canonical  forms  for  the 
decision  models  under  study.  These  studies  will  be  reported  at 

future  C3  workshops. 


